Porter County
Large Language Models Still Face Challenges in Multi-Hop Reasoning with External Knowledge
We carry out a series of experiments to test large language models' multi-hop reasoning ability from three aspects: selecting and combining external knowledge, dealing with non-sequential reasoning tasks and generalising to data samples with larger numbers of hops. We test the GPT-3.5 model on four reasoning benchmarks with Chain-of-Thought prompting (and its variations). Our results reveal that despite the amazing performance achieved by large language models on various reasoning tasks, models still suffer from severe drawbacks which shows a large gap with humans.
- Asia > China (0.14)
- North America > United States > California > Los Angeles County (0.14)
- Asia > South Korea (0.05)
- (18 more...)
- Media > Film (1.00)
- Leisure & Entertainment > Sports > Basketball (1.00)
- Health & Medicine > Therapeutic Area (1.00)
- (4 more...)
Pixels and Predictions: Potential of GPT-4V in Meteorological Imagery Analysis and Forecast Communication
Lawson, John R., Flora, Montgomery L., Goebbert, Kevin H., Lyman, Seth N., Potvin, Corey K., Schultz, David M., Stepanek, Adam J., Trujillo-Falcón, Joseph E.
Generative AI, such as OpenAI's GPT-4V large-language model, has rapidly entered mainstream discourse. Novel capabilities in image processing and natural-language communication may augment existing forecasting methods. Large language models further display potential to better communicate weather hazards in a style honed for diverse communities and different languages. This study evaluates GPT-4V's ability to interpret meteorological charts and communicate weather hazards appropriately to the user, despite challenges of hallucinations, where generative AI delivers coherent, confident, but incorrect responses. We assess GPT-4V's competence via its web interface ChatGPT in two tasks: (1) generating a severe-weather outlook from weather-chart analysis and conducting self-evaluation, revealing an outlook that corresponds well with a Storm Prediction Center human-issued forecast; and (2) producing hazard summaries in Spanish and English from weather charts. Responses in Spanish, however, resemble direct (not idiomatic) translations from English to Spanish, yielding poorly translated summaries that lose critical idiomatic precision required for optimal communication. Our findings advocate for cautious integration of tools like GPT-4V in meteorology, underscoring the necessity of human oversight and development of trustworthy, explainable AI.
- North America > United States > Oklahoma > Cleveland County > Norman (0.14)
- North America > United States > Illinois (0.05)
- North America > United States > Texas (0.05)
- (12 more...)
- Information Technology > Artificial Intelligence > Natural Language > Large Language Model (1.00)
- Information Technology > Artificial Intelligence > Natural Language > Chatbot (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Neural Networks > Deep Learning > Generative AI (0.75)
Ontologizing Health Systems Data at Scale: Making Translational Discovery a Reality
Callahan, Tiffany J., Stefanski, Adrianne L., Wyrwa, Jordan M., Zeng, Chenjie, Ostropolets, Anna, Banda, Juan M., Baumgartner, William A. Jr., Boyce, Richard D., Casiraghi, Elena, Coleman, Ben D., Collins, Janine H., Deakyne-Davies, Sara J., Feinstein, James A., Haendel, Melissa A., Lin, Asiyah Y., Martin, Blake, Matentzoglu, Nicolas A., Meeker, Daniella, Reese, Justin, Sinclair, Jessica, Taneja, Sanya B., Trinkley, Katy E., Vasilevsky, Nicole A., Williams, Andrew, Zhang, Xingman A., Denny, Joshua C., Robinson, Peter N., Ryan, Patrick, Hripcsak, George, Bennett, Tellen D., Hunter, Lawrence E., Kahn, Michael G.
Background: Common data models solve many challenges of standardizing electronic health record (EHR) data, but are unable to semantically integrate all the resources needed for deep phenotyping. Open Biological and Biomedical Ontology (OBO) Foundry ontologies provide computable representations of biological knowledge and enable the integration of heterogeneous data. However, mapping EHR data to OBO ontologies requires significant manual curation and domain expertise. Objective: We introduce OMOP2OBO, an algorithm for mapping Observational Medical Outcomes Partnership (OMOP) vocabularies to OBO ontologies. Results: Using OMOP2OBO, we produced mappings for 92,367 conditions, 8611 drug ingredients, and 10,673 measurement results, which covered 68-99% of concepts used in clinical practice when examined across 24 hospitals. When used to phenotype rare disease patients, the mappings helped systematically identify undiagnosed patients who might benefit from genetic testing. Conclusions: By aligning OMOP vocabularies to OBO ontologies our algorithm presents new opportunities to advance EHR-based deep phenotyping.
- Europe > United Kingdom > England > Cambridgeshire > Cambridge (0.27)
- North America > United States > Colorado > Adams County > Aurora (0.14)
- Oceania > Australia (0.04)
- (16 more...)
- Research Report > Experimental Study (1.00)
- Research Report > New Finding (0.68)
Network Classification and Categorization
Canning, James P., Ingram, Emma E., Nowak-Wolff, Sammantha, Ortiz, Adriana M., Ahmed, Nesreen K., Rossi, Ryan A., Schmitt, Karl R. B., Soundarajan, Sucheta
To the best of our knowledge, this paper presents the first large-scale study that tests whether network categories (e.g., social networks vs. web graphs) are distinguishable from one another (using both categories of real-world networks and synthetic graphs). A classification accuracy of $94.2\%$ was achieved using a random forest classifier with both real and synthetic networks. This work makes two important findings. First, real-world networks from various domains have distinct structural properties that allow us to predict with high accuracy the category of an arbitrary network. Second, classifying synthetic networks is trivial as our models can easily distinguish between synthetic graphs and the real-world networks they are supposed to model.
- North America > United States > Alabama > Tuscaloosa County > Tuscaloosa (0.15)
- North America > United States > New York > Onondaga County > Syracuse (0.05)
- North America > United States > Indiana > Porter County > Valparaiso (0.05)
- (3 more...)
- Information Technology (0.49)
- Health & Medicine > Therapeutic Area (0.30)
Cheaper Robots are Helping Small Businesses Survive
The robotics wave began sweeping into automobile and other plants decades ago, stopping short of shops staffed with a relative handful of people. Many businesses couldn't afford the contraptions, which weren't designed to squeeze into tight spaces or operate very close to human beings. A Rethink Robotics Inc. Baxter robot operated by DHL, a unit of Deutsche Post AG. Technological advances have made industrial robots more compact and kinder. Collaborative models, members of a new generation called cobots, have sensors to prevent them from harming real-life colleagues.
- North America > United States > Massachusetts (0.05)
- North America > United States > Indiana > Porter County > Valparaiso (0.05)
- North America > United States > Indiana > Floyd County > New Albany (0.05)
- (4 more...)
- Transportation (0.77)
- Information Technology > Robotics & Automation (0.37)
Quality Classifiers for Open Source Software Repositories
Tsatsaronis, George, Halkidi, Maria, Giakoumakis, Emmanouel A.
Initial open source software (OSS) projects rely on large repositories for hosting and distribution until they become independent. A huge amount of project metadata is collected and maintained in such software repositories providing useful information about projects and their success. In this paper we propose a data mining approach that processes the metadata contained in such OSS repositories. The proposed approach aims at the construction of a classifier that is trained on the metadata of existing projects and predicts the successful continuation of any given OSS. The successfulness of a project is defined with regard to the confidence level of the classifier which predicts that this project will be ported in widely used OSS projects (e.g.
- North America > United States > Indiana > Porter County > Portage (0.04)
- Europe > France (0.04)
- North America > United States > Nebraska > Lancaster County > Lincoln (0.14)
- North America > United States > California > San Francisco County > San Francisco (0.14)
- North America > United States > California > Los Angeles County > Los Angeles (0.14)
- (41 more...)